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1 Synonyms 



Wait-free registers, wait-free shared variables, asynchronous communication 
hardware. 



2 Problem Definition 

Consider a system of asynchronous processes that communicate among them- 
selves by only executing read and write operations on a set of shared variables 
(also known as shared registers). The system has no global clock or other 
synchronization primitives. Every shared variable is associated with a process 
(called owner) which writes it and the other processes may read it. An exe- 
cution of a write (read) operation on a shared variable will be referred to as a 
Write (Read) on that variable. A Write on a shared variable puts a value from a 
pre-determined finite domain into the variable, and a Read reports a value from 
the domain. A process that writes (reads) a variable is called a writer (reader) 
of the variable. 

We want to construct shared variables in which the following two properties 
hold. (1) Operation executions are not necessarily atomic, that is, they are not 
indivisible but rather consist of atomic sub-operations, and (2) every operation 
finishes its execution within a bounded number of its own steps, irrespective of 
the presence of other operation executions and their relative speeds. That is, 
operation executions are wait-free. These two properties give rise to a classifica- 
tion of shared variables, depending on their output characteristics. Lamport j8j 
distinguishes three categories for f-writer shared variables, using a precedence 
relation on operation executions defined as follows: for operation executions A 
and B, A precedes B, denoted A — ► B, if A finishes before B starts; A and 
B overlap if neither A precedes B nor B precedes A. In I-writer variables, all 
the Writes are totally ordered by " — ►" . The three categories of 1-writer shared 
variables defined by Lamport are the following. 

1. A safe variable is one in which a Read not overlapping any Write returns 
the most recently written value. A Read that overlaps a Write may return 
any value from the domain of the variable. 
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2. A regular variable is a safe variable in which a Read that overlaps one or 
more Writes returns either the value of the most recent Write preceding 
the Read or of one of the overlapping Writes. 

3. An atomic variable is a regular variable in which the Reads and Writes 
behave as if they occur in some total order which is an extension of the 
precedence relation. 

A shared variable is feooZearfl or multivalued depending upon whether it can 
hold only two or more than two values. A multiwriter shared variable is one 
that can be written and read (concurrently) by many processes. If there is only 
one writer and more than one reader it is called a multireader variable. 

3 Key Results 

In a series of papers starting in 1974, for details see [4], Lamport explored vari- 
ous notions of concurrent reading and writing of shared variables culminating in 
the seminal 1986 paper [8], It formulates the notion of wait-free implementation 
of an atomic multivalued shared variable — written by a single writer and read 
by (another) single reader — from safe 1-writer 1-reader 2-valued shared vari- 
ables, being mathematical versions of physical flip-flops, later optimized in [T3] . 
Lamport did not consider constructions of shared variables with more than one 
writer or reader. 

Predating the Lamport paper, in 1983 Peterson [TU] published an ingenious 
wait-free construction of an atomic 1-writer, n-reader m-valued atomic shared 
variable from n+2 safe 1-writer n-reader m-valued registers, 2n 1-writer 1-reader 
2-valued atomic shared variables, and 2 1-writer n-reader 2-valued atomic shared 
variables. He presented also a proper notion of wait-freedom property. In his pa- 
per, Peterson didn't tell how to construct the n-reader boolean atomic variables 
from flip-flops, while Lamport mentioned the open problem of doing so, and, in- 
cidentally, uses a version of Peterson's construction to bridge the algorithmically 
demanding step from atomic shared bits to atomic shared multivalues. Based 
on this work, N. Lynch, motivated by concurrency control of multi-user data- 
bases, posed around 1985 the question of how to construct wait-free multiwriter 
atomic variables from 1-writer multireader atomic variables. Her student Bloom 
[T] found in 1985 an elegant 2-writer construction, which, however, has resisted 
generalization to multiwriter. Vitanyi and Awerbuch [14] were the first to define 
and explore the complicated notion of wait-free constructions of general multi- 
writer atomic variables, 1986. They presented a proof method, an unbounded 
solution from 1-writer 1-reader atomic variables, and a bounded solution from 
1-writer n-reader atomic variables. The bounded solution turned out not to be 
atomic, but only achieved regularity ("Errata" in [14 ). The paper introduced 
important notions and techniques in the area, like (bounded) vector clocks, 
and identified open problems like the construction of atomic wait-free bounded 

1 Boolean variables are referred to as bits. 
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multireader shared variables from flip-flops, and atomic wait-free bounded mul- 
tiwriter shared variables from the mulireader ones. Peterson who had been 
working on the multiwriter problem for a decade, together with Burns, tried in 
1987 to eliminate the error in the unbounded construction of [13] retaining the 
idea of vector clocks, but replacing the obsolete-information tracking technique 
by repeated scanning as in [TU] . The result [TT] was found to be erroneous in the 
technical report (R. Schaffer, On the correctness of atomic multiwriter registers, 
Report MIT/LCS/TM-364, 1988). Neither the re-correction in Schaffer's Tech 
Report, nor the claimed re-correction by the authors of [TT] has appeared in 
print. Also in 1987 there appeared at least five purported solutions for the im- 
plementation of 1-writer n-reader atomic shared variable from 1-writer 1-reader 
ones: [3 [2] [12] (for the others see [4]) of which [2] was shown to be incorrect 
(S. Haldar, K. Vidyasankar, ACM Oper. Syst. Rev, 26:1(1992), 87-88) and 
only [12] appeared in journal version. The paper [9], intially a 1987 Harvard 
Tech Report, resolved all multiuser constructions in one stroke: it constructs 
a bounded n- writer n-reader (multiwriter) atomic variable from 0(n 2 ) 1-writer 
1-reader safe bits, which is optimal, and 0(n 2 ) bit-accesses per Read/Write op- 
eration which is optimal as well. It works by making the unbounded solution 
of [14] bounded, using a new technique, achieving a robust proof of correct- 
ness. "Projections" of the construction give specialized constructions for the 
implementation of 1-writer n-reader (multireader) atomic variables from 0(n 2 ) 
1-writer 1-reader ones using 0(n) bit accesses per Read/Write operation, and 
for the implementation of n- writer n-reader (multiwriter) atomic variables from 
n 1-writer n-reader (multireader) ones. The first "projection" is optimal, while 
the last "projection" may not be optimal since it uses 0(n) control bits per 
writer while only a lower bound of fi(logn.) was established. Taking up this 
challenge, the construction in \§\ claims to achieve this lower bound. 

Timestamp system: In a multiwriter shared variable it is only required 
that every process keeps track of which process wrote last. There arises the 
general question whether every process can keep track of the order of the last 
Writes by all processes. A. Israeli and M. Li were attracted to the area by the 
work in [TT] , and, in an important paper [5] , they raised and solved the question 
of the more general and universally useful notion of bounded timestamp system 
to track the order of events in a concurrent system. In a timestamp system 
every process owns an object, an abstraction of a set of shared variables. One of 
the requirements of the system is to determine the temporal order in which the 
objects are written. For this purpose, each object is given a label (also referred 
to as timestamp) which indicates the latest (relative) time when it has been 
written by its owner process. The processes assign labels to their respective ob- 
jects in such a way that the labels reflect the real-time order in which they are 
written to. These systems must support two operations, namely labeling and 
scan. A labeling operation execution (Labeling, in short) assigns a new label to 
an object, and a scan operation execution (Scan, in short) enables a process to 
determine the ordering in which all the objects are written, that is, it returns 
a set of labeled-objects ordered temporally. We are concerned with those sys- 
tems where operations can be executed concurrently, in an overlapped fashion. 
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Moreover, operation executions must be wait-free, that is, each operation ex- 
ecution will take a bounded number of its own steps (the number of accesses 
to the shared space), irrespective of the presence of other operation executions 
and their relative speeds. Israeli and Li [5] constructed a bit-optimal bounded 
timestamp system for sequential operation executions. Their sequential times- 
tamp system was published in the above journal reference, but the preliminary 
concurrent timestamp system in the conference proceedings, of which a more 
detailed version has been circulated in manuscript form, has not been published 
in final form. The first generally accepted solution of the concurrent case of 
bounded timestamp system is due to Dolev and Shavit [3]. Their construction 
is of the type as in [5] and uses shared variables of size O(n), where n is the 
number of processes in the system. Each Labeling requires 0{n) steps, and 
each Scan 0(n 2 logn) steps. (A 'step' accesses an 0(n) bit variable.) In [4] the 
unbounded construction of [14] is corrected and extended to obtain an efficient 
version of the more general notion of bounded concurrent timestamp system. 

4 Applications 

Wait-free registers are, together with message-passing systems, the primary in- 
terprocess communication method in distributed computing theory. They form 
the basis of all constructions and protocols, as can be seen in the textbooks. 
Wait-free constructions of concurrent timestamp systems (CTSs, in short) have 
been shown to be a powerful tool for solving concurrency control problems such 
as various types of mutual exclusion, multiwriter multireadcr shared variables 
[T4] . and probabilistic consensus, by synthesizing a "wait-free clock" to sequence 
the actions in a concurrent system. For more details see [3]. 

5 Open Problems 

There is a great deal of work in the direction of register constructions that 
use less constituent parts, or simpler such parts, or parts that can tolerate 
more complex failures, than previous constructions referred to above. Only, 
of course, if the latter constructions were not yet optimal in the parameter 
concerned. Further directions are work on wait-free higher-typed objects, as 
mentioned above, hierarchies of such objects, and probabilistic constructions. 
This literature is too vast and diverse than can be surveyed here. 

References 

[1] Bloom, B. 1988. Constructing two-writer atomic registers. IEEE Trans, on 
Computers 37, 12, 1506-1514. 



4 



[2] Burns, J.E., and Peterson, G.L. 1987. Constructing multi-reader atomic 
values from non-atomic values. In Proc. 6th ACM Symp. Principles Distr. 
Comput., pp. 222-231. 

[3] Dolcv, D., and Shavit, N. 1997. Bounded concurrent time-stamp systems 
are constructiblc. Siam J. Comput. 26, 2, 418-455. 

[4] S. Haldar and P. Vitanyi. 2002. Bounded concurrent timestamp systems 
using vector clocks, J. Assoc. Comp. Mach. 49, 1, 101-126. 

[5] Israeli, A., and Li, M. 1993. Bounded time-stamps. Distribut. Comput. 6, 
205-209. (Preliminary, more extended, version in: In Proc. 28th IEEE 
Symp. Found. Comput. Set., pp. 371-382, 1987.) 

[6] Israeli, A., and Shaham, A. 1992. Optimal multi-writer multireader atomic 
register. In Proc. 11th ACM Symp. Principles Distr. Comput.. pp. 71-82. 

[7] Kirousis, L.M., Kranakis, E., and Vitanyi, P.M.B. 1987. Atomic multi- 
reader register. In Proc. Workshop Distributed Algorithms. Lect Notes Com- 
put Sci, vol 312. Springer, Berlin Heidelberg New York 1987, pp. 278-296. 

[8] Lamport, L. 1986. On interprocess communication — Part I: Basic formal- 
ism, Part II: Algorithms. Distributed Computing 1, 2, 77-101. 

[9] Li, M., Tromp, J., and Vitanyi, P.M.B. 1996. How to share concurrent 
wait-free variables. J. ACM 43, 4, 723-746. (Preliminary version: Li, M. 
and Vitanyi, P.M.B. 1987. A very simple construction for atomic multi- 
writer register, Tech. Rept. TR-01-87, Computer Science Dept., Harvard 
University, Nov.) 

[10] Peterson, G.L. 1983. Concurrent reading while writing. ACM Trans. Pro- 
gram. Lang. Syst. 5, 1, 56-65. 

[11] Peterson, G.L., and Burns, J.E. 1987. Concurrent reading while writing 
II: The multiwriter case. In Proc. 28th IEEE Symp. Found. Comput. Sci.. 
pp. 383-392. 

[12] Singh, A.K., Anderson, J.H., and Gouda, M.G. 1994. The elusive atomic 
register. J. ACM 41, 2, 311-339. (Preliminary version in: Proc. 6th ACM 
Symp. Principles Distribt. Comput., 1987.) 

[13] Tromp, J. 1989. How to construct an atomic variable. In Proc. Workshop 
Distrib. Algorithms. Lect Notes Comput Sci, vol 392. Springer, Berlin Hei- 
delberg New York 1989, pp. 292-302. 

[14] Vitanyi, P.M.B., and Awerbuch, B. 1986. Atomic shared register access 
by asynchronous hardware. In Proc. 27th IEEE Symp. Found. Comput. 
Sci.. pp. 233-243. Errata, Proc. 28th IEEE Symp. Found. Comput. Sci.. 
pp. 487 487. 



5 



